Dataset statistics
| Number of variables | 17 |
|---|---|
| Number of observations | 173216 |
| Missing cells | 173223 |
| Missing cells (%) | 5.9% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 22.5 MiB |
| Average record size in memory | 136.0 B |
Variable types
| Numeric | 9 |
|---|---|
| Categorical | 7 |
| Unsupported | 1 |
rate_code_group has constant value "Others" | Constant |
pickup_datetime has a high cardinality: 38803 distinct values | High cardinality |
dropoff_datetime has a high cardinality: 104237 distinct values | High cardinality |
pickup_longitude is highly correlated with pickup_latitude | High correlation |
pickup_latitude is highly correlated with pickup_longitude | High correlation |
trip_distance is highly correlated with fare_amount | High correlation |
fare_amount is highly correlated with trip_distance | High correlation |
tip_amount is highly correlated with tip_paid | High correlation |
tip_paid is highly correlated with tip_amount | High correlation |
pickup_longitude is highly correlated with pickup_latitude | High correlation |
pickup_latitude is highly correlated with pickup_longitude | High correlation |
dropoff_longitude is highly correlated with dropoff_latitude | High correlation |
dropoff_latitude is highly correlated with dropoff_longitude | High correlation |
trip_distance is highly correlated with fare_amount | High correlation |
fare_amount is highly correlated with trip_distance | High correlation |
tip_amount is highly correlated with tip_paid | High correlation |
tip_paid is highly correlated with tip_amount | High correlation |
trip_distance is highly correlated with fare_amount | High correlation |
fare_amount is highly correlated with trip_distance | High correlation |
tip_amount is highly correlated with tip_paid | High correlation |
tip_paid is highly correlated with tip_amount | High correlation |
pickup_latitude is highly correlated with pickup_longitude | High correlation |
fare_amount is highly correlated with trip_distance | High correlation |
payment_type is highly correlated with tip_paid | High correlation |
dropoff_longitude is highly correlated with dropoff_latitude | High correlation |
tip_paid is highly correlated with payment_type | High correlation |
dropoff_latitude is highly correlated with dropoff_longitude | High correlation |
pickup_longitude is highly correlated with pickup_latitude | High correlation |
trip_distance is highly correlated with fare_amount | High correlation |
payment_type is highly correlated with tip_paid and 1 other fields | High correlation |
tip_paid is highly correlated with payment_type and 1 other fields | High correlation |
rate_code_group is highly correlated with payment_type and 3 other fields | High correlation |
pickup_year is highly correlated with rate_code_group | High correlation |
vendor_id is highly correlated with rate_code_group | High correlation |
rate_code has 173216 (100.0%) missing values | Missing |
df_index has unique values | Unique |
rate_code is an unsupported type, check if it needs cleaning or further analysis | Unsupported |
tip_amount has 132721 (76.6%) zeros | Zeros |
Reproduction
| Analysis started | 2021-07-02 10:14:03.150965 |
|---|---|
| Analysis finished | 2021-07-02 10:14:47.528069 |
| Duration | 44.38 seconds |
| Software version | pandas-profiling v3.0.0 |
| Download configuration | config.json |
| Distinct | 173216 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 536501.5263 |
| Minimum | 25 |
|---|---|
| Maximum | 1071895 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 25 |
|---|---|
| 5-th percentile | 53300.5 |
| Q1 | 267699 |
| median | 535609.5 |
| Q3 | 806440.5 |
| 95-th percentile | 1018794.5 |
| Maximum | 1071895 |
| Range | 1071870 |
| Interquartile range (IQR) | 538741.5 |
Descriptive statistics
| Standard deviation | 310189.4109 |
|---|---|
| Coefficient of variation (CV) | 0.5781706028 |
| Kurtosis | -1.206061358 |
| Mean | 536501.5263 |
| Median Absolute Deviation (MAD) | 269417 |
| Skewness | -0.0004635810034 |
| Sum | 9.293064838 × 1010 |
| Variance | 9.621747063 × 1010 |
| Monotonicity | Strictly increasing |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 526335 | 1 | < 0.1% |
| 826681 | 1 | < 0.1% |
| 740675 | 1 | < 0.1% |
| 738626 | 1 | < 0.1% |
| 1004864 | 1 | < 0.1% |
| 306495 | 1 | < 0.1% |
| 796747 | 1 | < 0.1% |
| 48445 | 1 | < 0.1% |
| 570684 | 1 | < 0.1% |
| 296250 | 1 | < 0.1% |
| Other values (173206) | 173206 |
| Value | Count | Frequency (%) |
| 25 | 1 | |
| 33 | 1 | |
| 34 | 1 | |
| 38 | 1 | |
| 46 | 1 | |
| 47 | 1 | |
| 49 | 1 | |
| 57 | 1 | |
| 60 | 1 | |
| 61 | 1 |
| Value | Count | Frequency (%) |
| 1071895 | 1 | |
| 1071881 | 1 | |
| 1071875 | 1 | |
| 1071856 | 1 | |
| 1071845 | 1 | |
| 1071836 | 1 | |
| 1071821 | 1 | |
| 1071803 | 1 | |
| 1071798 | 1 | |
| 1071790 | 1 |
| Distinct | 3 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 1.3 MiB |
| VTS | |
|---|---|
| CMT | |
| DDS |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Characters and Unicode
| Total characters | 519648 |
|---|---|
| Distinct characters | 6 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | VTS |
|---|---|
| 2nd row | CMT |
| 3rd row | VTS |
| 4th row | VTS |
| 5th row | VTS |
Common Values
| Value | Count | Frequency (%) |
| VTS | 86515 | |
| CMT | 77254 | |
| DDS | 9447 | 5.5% |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| vts | 86515 | |
| cmt | 77254 | |
| dds | 9447 | 5.5% |
Most occurring characters
| Value | Count | Frequency (%) |
| T | 163769 | |
| S | 95962 | |
| V | 86515 | |
| C | 77254 | |
| M | 77254 | |
| D | 18894 | 3.6% |
Most occurring categories
| Value | Count | Frequency (%) |
| Uppercase Letter | 519648 |
Most frequent character per category
Uppercase Letter
| Value | Count | Frequency (%) |
| T | 163769 | |
| S | 95962 | |
| V | 86515 | |
| C | 77254 | |
| M | 77254 | |
| D | 18894 | 3.6% |
Most occurring scripts
| Value | Count | Frequency (%) |
| Latin | 519648 |
Most frequent character per script
Latin
| Value | Count | Frequency (%) |
| T | 163769 | |
| S | 95962 | |
| V | 86515 | |
| C | 77254 | |
| M | 77254 | |
| D | 18894 | 3.6% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 519648 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| T | 163769 | |
| S | 95962 | |
| V | 86515 | |
| C | 77254 | |
| M | 77254 | |
| D | 18894 | 3.6% |
| Distinct | 38803 |
|---|---|
| Distinct (%) | 22.4% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 1.3 MiB |
| 2009-04-23 19:28:00+00:00 | 214 |
|---|---|
| 2009-10-21 19:31:00+00:00 | 205 |
| 2009-03-10 18:28:00+00:00 | 202 |
| 2009-04-07 19:04:00+00:00 | 202 |
| 2009-01-24 20:08:00+00:00 | 200 |
| Other values (38798) |
Length
| Max length | 25 |
|---|---|
| Median length | 25 |
| Mean length | 25 |
| Min length | 25 |
Characters and Unicode
| Total characters | 4330400 |
|---|---|
| Distinct characters | 14 |
| Distinct categories | 5 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 13832 ? |
|---|---|
| Unique (%) | 8.0% |
Sample
| 1st row | 2009-11-23 15:45:00+00:00 |
|---|---|
| 2nd row | 2009-10-10 01:29:17+00:00 |
| 3rd row | 2009-10-01 19:31:00+00:00 |
| 4th row | 2009-03-20 01:53:00+00:00 |
| 5th row | 2009-12-14 18:34:00+00:00 |
Common Values
| Value | Count | Frequency (%) |
| 2009-04-23 19:28:00+00:00 | 214 | 0.1% |
| 2009-10-21 19:31:00+00:00 | 205 | 0.1% |
| 2009-03-10 18:28:00+00:00 | 202 | 0.1% |
| 2009-04-07 19:04:00+00:00 | 202 | 0.1% |
| 2009-01-24 20:08:00+00:00 | 200 | 0.1% |
| 2009-01-31 18:40:00+00:00 | 199 | 0.1% |
| 2009-02-26 18:47:00+00:00 | 196 | 0.1% |
| 2009-06-23 18:52:00+00:00 | 196 | 0.1% |
| 2009-01-26 19:26:00+00:00 | 195 | 0.1% |
| 2009-10-01 19:31:00+00:00 | 194 | 0.1% |
| Other values (38793) | 171213 |
Length
Histogram of lengths of the category
| Value | Count | Frequency (%) |
| 2009-04-23 | 1136 | 0.3% |
| 2009-08-07 | 1077 | 0.3% |
| 2009-02-26 | 1057 | 0.3% |
| 2009-10-27 | 1037 | 0.3% |
| 2009-08-18 | 1031 | 0.3% |
| 2009-05-22 | 1016 | 0.3% |
| 2009-05-16 | 972 | 0.3% |
| 2009-07-15 | 953 | 0.3% |
| 2009-03-14 | 939 | 0.3% |
| 2009-09-17 | 902 | 0.3% |
| Other values (31144) | 336312 |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 1562784 | |
| : | 519648 | 12.0% |
| 2 | 398327 | 9.2% |
| - | 346432 | 8.0% |
| 1 | 336629 | 7.8% |
| 9 | 250467 | 5.8% |
| 173216 | 4.0% | |
| + | 173216 | 4.0% |
| 3 | 124425 | 2.9% |
| 5 | 113171 | 2.6% |
| Other values (4) | 332085 | 7.7% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 3117888 | |
| Other Punctuation | 519648 | 12.0% |
| Dash Punctuation | 346432 | 8.0% |
| Space Separator | 173216 | 4.0% |
| Math Symbol | 173216 | 4.0% |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 1562784 | |
| 2 | 398327 | 12.8% |
| 1 | 336629 | 10.8% |
| 9 | 250467 | 8.0% |
| 3 | 124425 | 4.0% |
| 5 | 113171 | 3.6% |
| 4 | 110821 | 3.6% |
| 8 | 79325 | 2.5% |
| 7 | 75045 | 2.4% |
| 6 | 66894 | 2.1% |
Dash Punctuation
| Value | Count | Frequency (%) |
| - | 346432 |
Space Separator
| Value | Count | Frequency (%) |
| 173216 |
Other Punctuation
| Value | Count | Frequency (%) |
| : | 519648 |
Math Symbol
| Value | Count | Frequency (%) |
| + | 173216 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 4330400 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 1562784 | |
| : | 519648 | 12.0% |
| 2 | 398327 | 9.2% |
| - | 346432 | 8.0% |
| 1 | 336629 | 7.8% |
| 9 | 250467 | 5.8% |
| 173216 | 4.0% | |
| + | 173216 | 4.0% |
| 3 | 124425 | 2.9% |
| 5 | 113171 | 2.6% |
| Other values (4) | 332085 | 7.7% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 4330400 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 1562784 | |
| : | 519648 | 12.0% |
| 2 | 398327 | 9.2% |
| - | 346432 | 8.0% |
| 1 | 336629 | 7.8% |
| 9 | 250467 | 5.8% |
| 173216 | 4.0% | |
| + | 173216 | 4.0% |
| 3 | 124425 | 2.9% |
| 5 | 113171 | 2.6% |
| Other values (4) | 332085 | 7.7% |
| Distinct | 104237 |
|---|---|
| Distinct (%) | 60.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 1.3 MiB |
| 2009-12-04 21:19:00+00:00 | 31 |
|---|---|
| 2009-12-04 21:21:00+00:00 | 27 |
| 2009-02-21 22:32:00+00:00 | 26 |
| 2009-03-10 18:34:00+00:00 | 25 |
| 2009-10-27 22:55:00+00:00 | 25 |
| Other values (104232) |
Length
| Max length | 25 |
|---|---|
| Median length | 25 |
| Mean length | 25 |
| Min length | 25 |
Characters and Unicode
| Total characters | 4330400 |
|---|---|
| Distinct characters | 14 |
| Distinct categories | 5 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 90736 ? |
|---|---|
| Unique (%) | 52.4% |
Sample
| 1st row | 2009-11-23 15:54:00+00:00 |
|---|---|
| 2nd row | 2009-10-10 01:45:40+00:00 |
| 3rd row | 2009-10-01 19:45:00+00:00 |
| 4th row | 2009-03-20 01:59:00+00:00 |
| 5th row | 2009-12-14 18:41:00+00:00 |
Common Values
| Value | Count | Frequency (%) |
| 2009-12-04 21:19:00+00:00 | 31 | < 0.1% |
| 2009-12-04 21:21:00+00:00 | 27 | < 0.1% |
| 2009-02-21 22:32:00+00:00 | 26 | < 0.1% |
| 2009-03-10 18:34:00+00:00 | 25 | < 0.1% |
| 2009-10-27 22:55:00+00:00 | 25 | < 0.1% |
| 2009-11-10 08:47:00+00:00 | 25 | < 0.1% |
| 2009-12-04 21:18:00+00:00 | 24 | < 0.1% |
| 2009-01-24 20:13:00+00:00 | 24 | < 0.1% |
| 2009-10-27 22:56:00+00:00 | 24 | < 0.1% |
| 2009-10-24 21:42:00+00:00 | 23 | < 0.1% |
| Other values (104227) | 172962 |
Length
Histogram of lengths of the category
| Value | Count | Frequency (%) |
| 2009-04-23 | 1140 | 0.3% |
| 2009-08-07 | 1073 | 0.3% |
| 2009-02-26 | 1057 | 0.3% |
| 2009-10-27 | 1036 | 0.3% |
| 2009-08-18 | 1029 | 0.3% |
| 2009-05-22 | 1015 | 0.3% |
| 2009-05-16 | 972 | 0.3% |
| 2009-07-15 | 954 | 0.3% |
| 2009-03-14 | 946 | 0.3% |
| 2009-09-17 | 900 | 0.3% |
| Other values (52690) | 336310 |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 1563182 | |
| : | 519648 | 12.0% |
| 2 | 397029 | 9.2% |
| - | 346432 | 8.0% |
| 1 | 337701 | 7.8% |
| 9 | 252740 | 5.8% |
| 173216 | 4.0% | |
| + | 173216 | 4.0% |
| 3 | 126106 | 2.9% |
| 5 | 112560 | 2.6% |
| Other values (4) | 328570 | 7.6% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 3117888 | |
| Other Punctuation | 519648 | 12.0% |
| Dash Punctuation | 346432 | 8.0% |
| Space Separator | 173216 | 4.0% |
| Math Symbol | 173216 | 4.0% |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 1563182 | |
| 2 | 397029 | 12.7% |
| 1 | 337701 | 10.8% |
| 9 | 252740 | 8.1% |
| 3 | 126106 | 4.0% |
| 5 | 112560 | 3.6% |
| 4 | 110777 | 3.6% |
| 8 | 76548 | 2.5% |
| 7 | 73233 | 2.3% |
| 6 | 68012 | 2.2% |
Dash Punctuation
| Value | Count | Frequency (%) |
| - | 346432 |
Space Separator
| Value | Count | Frequency (%) |
| 173216 |
Other Punctuation
| Value | Count | Frequency (%) |
| : | 519648 |
Math Symbol
| Value | Count | Frequency (%) |
| + | 173216 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 4330400 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 1563182 | |
| : | 519648 | 12.0% |
| 2 | 397029 | 9.2% |
| - | 346432 | 8.0% |
| 1 | 337701 | 7.8% |
| 9 | 252740 | 5.8% |
| 173216 | 4.0% | |
| + | 173216 | 4.0% |
| 3 | 126106 | 2.9% |
| 5 | 112560 | 2.6% |
| Other values (4) | 328570 | 7.6% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 4330400 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 1563182 | |
| : | 519648 | 12.0% |
| 2 | 397029 | 9.2% |
| - | 346432 | 8.0% |
| 1 | 337701 | 7.8% |
| 9 | 252740 | 5.8% |
| 173216 | 4.0% | |
| + | 173216 | 4.0% |
| 3 | 126106 | 2.9% |
| 5 | 112560 | 2.6% |
| Other values (4) | 328570 | 7.6% |
| Distinct | 48301 |
|---|---|
| Distinct (%) | 27.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | -73.97689252 |
| Minimum | -73.999999 |
|---|---|
| Maximum | -73.900044 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 173216 |
| Negative (%) | 100.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | -73.999999 |
|---|---|
| 5-th percentile | -73.99608725 |
| Q1 | -73.987858 |
| median | -73.97946 |
| Q3 | -73.968017 |
| 95-th percentile | -73.95190375 |
| Maximum | -73.900044 |
| Range | 0.099955 |
| Interquartile range (IQR) | 0.019841 |
Descriptive statistics
| Standard deviation | 0.01427508304 |
|---|---|
| Coefficient of variation (CV) | -0.000192966784 |
| Kurtosis | 0.8538684583 |
| Mean | -73.97689252 |
| Median Absolute Deviation (MAD) | 0.009428 |
| Skewness | 0.830872692 |
| Sum | -12813981.41 |
| Variance | 0.0002037779957 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| -73.98225 | 36 | < 0.1% |
| -73.982179 | 30 | < 0.1% |
| -73.981918 | 30 | < 0.1% |
| -73.98206 | 30 | < 0.1% |
| -73.982037 | 28 | < 0.1% |
| -73.981515 | 26 | < 0.1% |
| -73.980497 | 25 | < 0.1% |
| -73.981847 | 25 | < 0.1% |
| -73.982108 | 25 | < 0.1% |
| -73.981989 | 24 | < 0.1% |
| Other values (48291) | 172937 |
| Value | Count | Frequency (%) |
| -73.999999 | 1 | < 0.1% |
| -73.999998 | 5 | |
| -73.999997 | 4 | |
| -73.999996 | 1 | < 0.1% |
| -73.999995 | 4 | |
| -73.999993 | 5 | |
| -73.999992 | 2 | < 0.1% |
| -73.999991 | 1 | < 0.1% |
| -73.99999 | 2 | < 0.1% |
| -73.999989 | 2 | < 0.1% |
| Value | Count | Frequency (%) |
| -73.900044 | 1 | |
| -73.900147 | 1 | |
| -73.900205 | 1 | |
| -73.900227 | 1 | |
| -73.900367 | 1 | |
| -73.900405 | 1 | |
| -73.900453 | 1 | |
| -73.900532 | 1 | |
| -73.900887 | 1 | |
| -73.900895 | 1 |
| Distinct | 61265 |
|---|---|
| Distinct (%) | 35.4% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 40.75720439 |
| Minimum | 40.700005 |
|---|---|
| Maximum | 40.799997 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 40.700005 |
|---|---|
| 5-th percentile | 40.724768 |
| Q1 | 40.745138 |
| median | 40.758152 |
| Q3 | 40.76991825 |
| 95-th percentile | 40.78568225 |
| Maximum | 40.799997 |
| Range | 0.099992 |
| Interquartile range (IQR) | 0.02478025 |
Descriptive statistics
| Standard deviation | 0.01803157869 |
|---|---|
| Coefficient of variation (CV) | 0.0004424145119 |
| Kurtosis | -0.4393484571 |
| Mean | 40.75720439 |
| Median Absolute Deviation (MAD) | 0.012379 |
| Skewness | -0.1779794106 |
| Sum | 7059799.916 |
| Variance | 0.0003251378299 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 40.76281 | 22 | < 0.1% |
| 40.762935 | 22 | < 0.1% |
| 40.764173 | 22 | < 0.1% |
| 40.764065 | 22 | < 0.1% |
| 40.759437 | 21 | < 0.1% |
| 40.75124 | 20 | < 0.1% |
| 40.763438 | 20 | < 0.1% |
| 40.749858 | 19 | < 0.1% |
| 40.750307 | 19 | < 0.1% |
| 40.749805 | 19 | < 0.1% |
| Other values (61255) | 173010 |
| Value | Count | Frequency (%) |
| 40.700005 | 1 | |
| 40.700043 | 1 | |
| 40.700076 | 1 | |
| 40.70014 | 1 | |
| 40.700295 | 1 | |
| 40.700321 | 1 | |
| 40.700345 | 1 | |
| 40.700382 | 1 | |
| 40.700428 | 1 | |
| 40.700437 | 1 |
| Value | Count | Frequency (%) |
| 40.799997 | 1 | |
| 40.799983 | 1 | |
| 40.799981 | 1 | |
| 40.799978 | 1 | |
| 40.799977 | 1 | |
| 40.799975 | 2 | |
| 40.799973 | 1 | |
| 40.799968 | 1 | |
| 40.799963 | 1 | |
| 40.799962 | 2 |
| Distinct | 50541 |
|---|---|
| Distinct (%) | 29.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | -73.97561718 |
| Minimum | -73.999999 |
|---|---|
| Maximum | -73.900017 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 173216 |
| Negative (%) | 100.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | -73.999999 |
|---|---|
| 5-th percentile | -73.99572525 |
| Q1 | -73.987 |
| median | -73.97839 |
| Q3 | -73.966923 |
| 95-th percentile | -73.949565 |
| Maximum | -73.900017 |
| Range | 0.099982 |
| Interquartile range (IQR) | 0.020077 |
Descriptive statistics
| Standard deviation | 0.01535660968 |
|---|---|
| Coefficient of variation (CV) | -0.0002075901529 |
| Kurtosis | 1.753215749 |
| Mean | -73.97561718 |
| Median Absolute Deviation (MAD) | 0.009578 |
| Skewness | 1.059273186 |
| Sum | -12813760.5 |
| Variance | 0.0002358254609 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| -73.982368 | 28 | < 0.1% |
| -73.991228 | 25 | < 0.1% |
| -73.991015 | 24 | < 0.1% |
| -73.990825 | 23 | < 0.1% |
| -73.991678 | 23 | < 0.1% |
| -73.983292 | 23 | < 0.1% |
| -73.979715 | 23 | < 0.1% |
| -73.988148 | 22 | < 0.1% |
| -73.98206 | 22 | < 0.1% |
| -73.981018 | 22 | < 0.1% |
| Other values (50531) | 172981 |
| Value | Count | Frequency (%) |
| -73.999999 | 2 | < 0.1% |
| -73.999998 | 5 | |
| -73.999997 | 2 | < 0.1% |
| -73.999995 | 5 | |
| -73.999994 | 1 | < 0.1% |
| -73.999993 | 6 | |
| -73.999992 | 2 | < 0.1% |
| -73.99999 | 1 | < 0.1% |
| -73.999989 | 2 | < 0.1% |
| -73.999988 | 4 |
| Value | Count | Frequency (%) |
| -73.900017 | 1 | |
| -73.900037 | 1 | |
| -73.900072 | 1 | |
| -73.900074 | 1 | |
| -73.900089 | 1 | |
| -73.900092 | 1 | |
| -73.900135 | 1 | |
| -73.900163 | 1 | |
| -73.900166 | 1 | |
| -73.900178 | 1 |
| Distinct | 62864 |
|---|---|
| Distinct (%) | 36.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 40.75764219 |
| Minimum | 40.700009 |
|---|---|
| Maximum | 40.799998 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 40.700009 |
|---|---|
| 5-th percentile | 40.72419875 |
| Q1 | 40.745988 |
| median | 40.7585425 |
| Q3 | 40.77070825 |
| 95-th percentile | 40.7871655 |
| Maximum | 40.799998 |
| Range | 0.099989 |
| Interquartile range (IQR) | 0.02472025 |
Descriptive statistics
| Standard deviation | 0.01858345416 |
|---|---|
| Coefficient of variation (CV) | 0.0004559501767 |
| Kurtosis | -0.2885797394 |
| Mean | 40.75764219 |
| Median Absolute Deviation (MAD) | 0.0123425 |
| Skewness | -0.232906668 |
| Sum | 7059875.749 |
| Variance | 0.0003453447684 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 40.750128 | 23 | < 0.1% |
| 40.755563 | 20 | < 0.1% |
| 40.764047 | 20 | < 0.1% |
| 40.762523 | 19 | < 0.1% |
| 40.750253 | 19 | < 0.1% |
| 40.756173 | 19 | < 0.1% |
| 40.762648 | 18 | < 0.1% |
| 40.763258 | 18 | < 0.1% |
| 40.76394 | 18 | < 0.1% |
| 40.760747 | 18 | < 0.1% |
| Other values (62854) | 173024 |
| Value | Count | Frequency (%) |
| 40.700009 | 1 | |
| 40.700028 | 1 | |
| 40.700038 | 1 | |
| 40.700041 | 2 | |
| 40.700047 | 1 | |
| 40.700055 | 1 | |
| 40.700069 | 1 | |
| 40.700097 | 1 | |
| 40.700108 | 1 | |
| 40.700135 | 1 |
| Value | Count | Frequency (%) |
| 40.799998 | 2 | |
| 40.799995 | 1 | |
| 40.799992 | 1 | |
| 40.79999 | 1 | |
| 40.799985 | 2 | |
| 40.799981 | 1 | |
| 40.79998 | 2 | |
| 40.799972 | 2 | |
| 40.79997 | 1 | |
| 40.799968 | 1 |
passenger_count
Real number (ℝ≥0)
| Distinct | 6 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.691217901 |
| Minimum | 1 |
|---|---|
| Maximum | 6 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 1 |
| median | 1 |
| Q3 | 2 |
| 95-th percentile | 5 |
| Maximum | 6 |
| Range | 5 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 1.259826671 |
|---|---|
| Coefficient of variation (CV) | 0.7449227387 |
| Kurtosis | 2.203046654 |
| Mean | 1.691217901 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 1.861627547 |
| Sum | 292946 |
| Variance | 1.58716324 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=6)
| Value | Count | Frequency (%) |
| 1 | 117931 | |
| 2 | 27615 | 15.9% |
| 5 | 15367 | 8.9% |
| 3 | 7854 | 4.5% |
| 4 | 3653 | 2.1% |
| 6 | 796 | 0.5% |
| Value | Count | Frequency (%) |
| 1 | 117931 | |
| 2 | 27615 | 15.9% |
| 3 | 7854 | 4.5% |
| 4 | 3653 | 2.1% |
| 5 | 15367 | 8.9% |
| 6 | 796 | 0.5% |
| Value | Count | Frequency (%) |
| 6 | 796 | 0.5% |
| 5 | 15367 | 8.9% |
| 4 | 3653 | 2.1% |
| 3 | 7854 | 4.5% |
| 2 | 27615 | 15.9% |
| 1 | 117931 |
| Distinct | 936 |
|---|---|
| Distinct (%) | 0.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1.772427374 |
| Minimum | 0.01 |
|---|---|
| Maximum | 14.2 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 0.01 |
|---|---|
| 5-th percentile | 0.5 |
| Q1 | 0.91 |
| median | 1.46 |
| Q3 | 2.3 |
| 95-th percentile | 4.1 |
| Maximum | 14.2 |
| Range | 14.19 |
| Interquartile range (IQR) | 1.39 |
Descriptive statistics
| Standard deviation | 1.192034872 |
|---|---|
| Coefficient of variation (CV) | 0.6725437045 |
| Kurtosis | 4.504261855 |
| Mean | 1.772427374 |
| Median Absolute Deviation (MAD) | 0.62 |
| Skewness | 1.732764087 |
| Sum | 307012.78 |
| Variance | 1.420947136 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 5016 | 2.9% |
| 0.9 | 4991 | 2.9% |
| 0.8 | 4985 | 2.9% |
| 1.1 | 4722 | 2.7% |
| 0.7 | 4568 | 2.6% |
| 1.2 | 4558 | 2.6% |
| 1.3 | 4360 | 2.5% |
| 0.6 | 4057 | 2.3% |
| 1.4 | 4043 | 2.3% |
| 1.5 | 3740 | 2.2% |
| Other values (926) | 128176 |
| Value | Count | Frequency (%) |
| 0.01 | 23 | < 0.1% |
| 0.02 | 26 | < 0.1% |
| 0.03 | 32 | < 0.1% |
| 0.04 | 24 | < 0.1% |
| 0.05 | 19 | < 0.1% |
| 0.06 | 14 | < 0.1% |
| 0.07 | 20 | < 0.1% |
| 0.08 | 10 | < 0.1% |
| 0.09 | 17 | < 0.1% |
| 0.1 | 97 |
| Value | Count | Frequency (%) |
| 14.2 | 1 | |
| 13.3 | 1 | |
| 12.94 | 1 | |
| 12.5 | 1 | |
| 12.2 | 1 | |
| 12.14 | 1 | |
| 11.93 | 1 | |
| 11.8 | 1 | |
| 11.7 | 2 | |
| 11.69 | 1 |
| Distinct | 4 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 1.3 MiB |
| CSH | |
|---|---|
| CRD | |
| NOC | 343 |
| DIS | 53 |
Length
| Max length | 3 |
|---|---|
| Median length | 3 |
| Mean length | 3 |
| Min length | 3 |
Characters and Unicode
| Total characters | 519648 |
|---|---|
| Distinct characters | 8 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | CSH |
|---|---|
| 2nd row | CSH |
| 3rd row | CSH |
| 4th row | CSH |
| 5th row | CSH |
Common Values
| Value | Count | Frequency (%) |
| CSH | 131390 | |
| CRD | 41430 | 23.9% |
| NOC | 343 | 0.2% |
| DIS | 53 | < 0.1% |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| csh | 131390 | |
| crd | 41430 | 23.9% |
| noc | 343 | 0.2% |
| dis | 53 | < 0.1% |
Most occurring characters
| Value | Count | Frequency (%) |
| C | 173163 | |
| S | 131443 | |
| H | 131390 | |
| D | 41483 | 8.0% |
| R | 41430 | 8.0% |
| N | 343 | 0.1% |
| O | 343 | 0.1% |
| I | 53 | < 0.1% |
Most occurring categories
| Value | Count | Frequency (%) |
| Uppercase Letter | 519648 |
Most frequent character per category
Uppercase Letter
| Value | Count | Frequency (%) |
| C | 173163 | |
| S | 131443 | |
| H | 131390 | |
| D | 41483 | 8.0% |
| R | 41430 | 8.0% |
| N | 343 | 0.1% |
| O | 343 | 0.1% |
| I | 53 | < 0.1% |
Most occurring scripts
| Value | Count | Frequency (%) |
| Latin | 519648 |
Most frequent character per script
Latin
| Value | Count | Frequency (%) |
| C | 173163 | |
| S | 131443 | |
| H | 131390 | |
| D | 41483 | 8.0% |
| R | 41430 | 8.0% |
| N | 343 | 0.1% |
| O | 343 | 0.1% |
| I | 53 | < 0.1% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 519648 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| C | 173163 | |
| S | 131443 | |
| H | 131390 | |
| D | 41483 | 8.0% |
| R | 41430 | 8.0% |
| N | 343 | 0.1% |
| O | 343 | 0.1% |
| I | 53 | < 0.1% |
| Distinct | 309 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 7.702362368 |
| Minimum | 2.5 |
|---|---|
| Maximum | 110 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 2.5 |
|---|---|
| 5-th percentile | 3.7 |
| Q1 | 5.3 |
| median | 6.9 |
| Q3 | 9.3 |
| 95-th percentile | 14.1 |
| Maximum | 110 |
| Range | 107.5 |
| Interquartile range (IQR) | 4 |
Descriptive statistics
| Standard deviation | 3.400448014 |
|---|---|
| Coefficient of variation (CV) | 0.4414811782 |
| Kurtosis | 18.65609008 |
| Mean | 7.702362368 |
| Median Absolute Deviation (MAD) | 2 |
| Skewness | 2.324401383 |
| Sum | 1334172.4 |
| Variance | 11.56304669 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 5.3 | 10648 | 6.1% |
| 5.7 | 10341 | 6.0% |
| 4.9 | 10213 | 5.9% |
| 6.1 | 10199 | 5.9% |
| 4.5 | 9575 | 5.5% |
| 6.5 | 9479 | 5.5% |
| 6.9 | 8879 | 5.1% |
| 7.3 | 8268 | 4.8% |
| 7.7 | 7736 | 4.5% |
| 4.1 | 7720 | 4.5% |
| Other values (299) | 80158 |
| Value | Count | Frequency (%) |
| 2.5 | 290 | 0.2% |
| 2.51 | 1 | < 0.1% |
| 2.9 | 620 | 0.4% |
| 3 | 10 | < 0.1% |
| 3.3 | 2491 | |
| 3.4 | 18 | < 0.1% |
| 3.5 | 5 | < 0.1% |
| 3.7 | 5235 | |
| 3.8 | 105 | 0.1% |
| 3.9 | 12 | < 0.1% |
| Value | Count | Frequency (%) |
| 110 | 1 | < 0.1% |
| 84 | 1 | < 0.1% |
| 53.3 | 1 | < 0.1% |
| 52.5 | 1 | < 0.1% |
| 50.5 | 2 | < 0.1% |
| 50 | 6 | < 0.1% |
| 49.57 | 17 | < 0.1% |
| 49.15 | 14 | < 0.1% |
| 45 | 60 | |
| 40.1 | 1 | < 0.1% |
| Distinct | 487 |
|---|---|
| Distinct (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.394561761 |
| Minimum | 0 |
|---|---|
| Maximum | 51 |
| Zeros | 132721 |
| Zeros (%) | 76.6% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 1.3 MiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 2 |
| Maximum | 51 |
| Range | 51 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.840789144 |
|---|---|
| Coefficient of variation (CV) | 2.130944321 |
| Kurtosis | 98.88960495 |
| Mean | 0.394561761 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 4.279487054 |
| Sum | 68344.41 |
| Variance | 0.7069263847 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 9531 | 5.5% |
| 2 | 9529 | 5.5% |
| 1.5 | 2384 | 1.4% |
| 3 | 2160 | 1.2% |
| 1.3 | 544 | 0.3% |
| 0.5 | 506 | 0.3% |
| 1.1 | 408 | 0.2% |
| 4 | 394 | 0.2% |
| 1.4 | 383 | 0.2% |
| Other values (477) | 14656 | 8.5% |
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 0.01 | 21 | < 0.1% |
| 0.02 | 13 | < 0.1% |
| 0.03 | 6 | < 0.1% |
| 0.04 | 2 | < 0.1% |
| 0.05 | 2 | < 0.1% |
| 0.06 | 1 | < 0.1% |
| 0.07 | 1 | < 0.1% |
| 0.08 | 2 | < 0.1% |
| 0.09 | 2 | < 0.1% |
| Value | Count | Frequency (%) |
| 51 | 1 | < 0.1% |
| 20.4 | 1 | < 0.1% |
| 20 | 6 | |
| 16.5 | 1 | < 0.1% |
| 12.55 | 1 | < 0.1% |
| 12 | 4 | |
| 11.6 | 2 | < 0.1% |
| 11.5 | 2 | < 0.1% |
| 11.4 | 1 | < 0.1% |
| 11.25 | 2 | < 0.1% |
| Distinct | 2 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 1.3 MiB |
| 0 | |
|---|---|
| 1 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 173216 |
|---|---|
| Distinct characters | 2 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 0 |
|---|---|
| 2nd row | 0 |
| 3rd row | 0 |
| 4th row | 0 |
| 5th row | 0 |
Common Values
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 40495 | 23.4% |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 40495 | 23.4% |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 40495 | 23.4% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 173216 |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 40495 | 23.4% |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 173216 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 40495 | 23.4% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 173216 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 132721 | |
| 1 | 40495 | 23.4% |
| Distinct | 1 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 1.3 MiB |
| Others |
|---|
Length
| Max length | 6 |
|---|---|
| Median length | 6 |
| Mean length | 6 |
| Min length | 6 |
Characters and Unicode
| Total characters | 1039296 |
|---|---|
| Distinct characters | 6 |
| Distinct categories | 2 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | Others |
|---|---|
| 2nd row | Others |
| 3rd row | Others |
| 4th row | Others |
| 5th row | Others |
Common Values
| Value | Count | Frequency (%) |
| Others | 173216 |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| others | 173216 |
Most occurring characters
| Value | Count | Frequency (%) |
| O | 173216 | |
| t | 173216 | |
| h | 173216 | |
| e | 173216 | |
| r | 173216 | |
| s | 173216 |
Most occurring categories
| Value | Count | Frequency (%) |
| Lowercase Letter | 866080 | |
| Uppercase Letter | 173216 | 16.7% |
Most frequent character per category
Lowercase Letter
| Value | Count | Frequency (%) |
| t | 173216 | |
| h | 173216 | |
| e | 173216 | |
| r | 173216 | |
| s | 173216 |
Uppercase Letter
| Value | Count | Frequency (%) |
| O | 173216 |
Most occurring scripts
| Value | Count | Frequency (%) |
| Latin | 1039296 |
Most frequent character per script
Latin
| Value | Count | Frequency (%) |
| O | 173216 | |
| t | 173216 | |
| h | 173216 | |
| e | 173216 | |
| r | 173216 | |
| s | 173216 |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 1039296 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| O | 173216 | |
| t | 173216 | |
| h | 173216 | |
| e | 173216 | |
| r | 173216 | |
| s | 173216 |
| Distinct | 2 |
|---|---|
| Distinct (%) | < 0.1% |
| Missing | 7 |
| Missing (%) | < 0.1% |
| Memory size | 1.3 MiB |
| 2009 | |
|---|---|
| 2008 | 54 |
Length
| Max length | 4 |
|---|---|
| Median length | 4 |
| Mean length | 4 |
| Min length | 4 |
Characters and Unicode
| Total characters | 692836 |
|---|---|
| Distinct characters | 4 |
| Distinct categories | 1 ? |
| Distinct scripts | 1 ? |
| Distinct blocks | 1 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 2009 |
|---|---|
| 2nd row | 2009 |
| 3rd row | 2009 |
| 4th row | 2009 |
| 5th row | 2009 |
Common Values
| Value | Count | Frequency (%) |
| 2009 | 173155 | |
| 2008 | 54 | < 0.1% |
| (Missing) | 7 | < 0.1% |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| 2009 | 173155 | |
| 2008 | 54 | < 0.1% |
Most occurring characters
| Value | Count | Frequency (%) |
| 0 | 346418 | |
| 2 | 173209 | |
| 9 | 173155 | |
| 8 | 54 | < 0.1% |
Most occurring categories
| Value | Count | Frequency (%) |
| Decimal Number | 692836 |
Most frequent character per category
Decimal Number
| Value | Count | Frequency (%) |
| 0 | 346418 | |
| 2 | 173209 | |
| 9 | 173155 | |
| 8 | 54 | < 0.1% |
Most occurring scripts
| Value | Count | Frequency (%) |
| Common | 692836 |
Most frequent character per script
Common
| Value | Count | Frequency (%) |
| 0 | 346418 | |
| 2 | 173209 | |
| 9 | 173155 | |
| 8 | 54 | < 0.1% |
Most occurring blocks
| Value | Count | Frequency (%) |
| ASCII | 692836 |
Most frequent character per block
ASCII
| Value | Count | Frequency (%) |
| 0 | 346418 | |
| 2 | 173209 | |
| 9 | 173155 | |
| 8 | 54 | < 0.1% |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here. A simple visualization of nullity by column.
Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.
The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.
First rows
| df_index | vendor_id | pickup_datetime | dropoff_datetime | pickup_longitude | pickup_latitude | dropoff_longitude | dropoff_latitude | rate_code | passenger_count | trip_distance | payment_type | fare_amount | tip_amount | tip_paid | rate_code_group | pickup_year | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 25 | VTS | 2009-11-23 15:45:00+00:00 | 2009-11-23 15:54:00+00:00 | -73.980932 | 40.754478 | -73.999478 | 40.738617 | NaN | 1 | 1.90 | CSH | 7.7 | 0.0 | 0 | Others | 2009 |
| 1 | 33 | CMT | 2009-10-10 01:29:17+00:00 | 2009-10-10 01:45:40+00:00 | -73.953836 | 40.770469 | -73.987500 | 40.744227 | NaN | 1 | 4.40 | CSH | 13.3 | 0.0 | 0 | Others | 2009 |
| 2 | 34 | VTS | 2009-10-01 19:31:00+00:00 | 2009-10-01 19:45:00+00:00 | -73.977180 | 40.762087 | -73.986268 | 40.756425 | NaN | 2 | 0.73 | CSH | 8.1 | 0.0 | 0 | Others | 2009 |
| 3 | 38 | VTS | 2009-03-20 01:53:00+00:00 | 2009-03-20 01:59:00+00:00 | -73.988992 | 40.736620 | -73.987647 | 40.728713 | NaN | 1 | 0.82 | CSH | 5.3 | 0.0 | 0 | Others | 2009 |
| 4 | 46 | VTS | 2009-12-14 18:34:00+00:00 | 2009-12-14 18:41:00+00:00 | -73.990737 | 40.734063 | -73.996930 | 40.740747 | NaN | 1 | 0.95 | CSH | 5.3 | 0.0 | 0 | Others | 2009 |
| 5 | 47 | VTS | 2009-02-27 22:55:00+00:00 | 2009-02-27 23:07:00+00:00 | -73.988765 | 40.722678 | -73.997277 | 40.741577 | NaN | 1 | 1.92 | CSH | 8.5 | 0.0 | 0 | Others | 2009 |
| 6 | 49 | VTS | 2009-05-31 23:20:00+00:00 | 2009-05-31 23:30:00+00:00 | -73.999480 | 40.752180 | -73.977587 | 40.749357 | NaN | 4 | 1.71 | CSH | 7.7 | 0.0 | 0 | Others | 2009 |
| 7 | 57 | DDS | 2009-04-16 23:36:39+00:00 | 2009-04-16 23:44:27+00:00 | -73.957471 | 40.774505 | -73.963228 | 40.795278 | NaN | 1 | 2.00 | CRD | 7.3 | 1.0 | 1 | Others | 2009 |
| 8 | 60 | CMT | 2009-12-10 17:48:14+00:00 | 2009-12-10 18:05:44+00:00 | -73.961764 | 40.774450 | -73.982187 | 40.736538 | NaN | 1 | 3.20 | CSH | 11.3 | 0.0 | 0 | Others | 2009 |
| 9 | 61 | CMT | 2009-04-25 15:36:22+00:00 | 2009-04-25 15:43:01+00:00 | -73.994957 | 40.739940 | -73.985768 | 40.758162 | NaN | 2 | 1.50 | CSH | 6.1 | 0.0 | 0 | Others | 2009 |
Last rows
| df_index | vendor_id | pickup_datetime | dropoff_datetime | pickup_longitude | pickup_latitude | dropoff_longitude | dropoff_latitude | rate_code | passenger_count | trip_distance | payment_type | fare_amount | tip_amount | tip_paid | rate_code_group | pickup_year | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 173206 | 1071790 | VTS | 2009-09-29 05:48:00+00:00 | 2009-09-29 05:54:00+00:00 | -73.999232 | 40.743838 | -73.980927 | 40.760217 | NaN | 1 | 1.59 | CSH | 6.1 | 0.0 | 0 | Others | 2009 |
| 173207 | 1071798 | VTS | 2009-11-18 08:02:00+00:00 | 2009-11-18 08:09:00+00:00 | -73.990783 | 40.755337 | -73.984623 | 40.745600 | NaN | 1 | 1.18 | CSH | 5.7 | 0.0 | 0 | Others | 2009 |
| 173208 | 1071803 | VTS | 2009-10-11 16:02:00+00:00 | 2009-10-11 16:16:00+00:00 | -73.957920 | 40.763248 | -73.948193 | 40.724575 | NaN | 1 | 4.38 | CSH | 12.9 | 0.0 | 0 | Others | 2009 |
| 173209 | 1071821 | CMT | 2009-12-04 12:07:56+00:00 | 2009-12-04 12:37:52+00:00 | -73.977582 | 40.746174 | -73.979804 | 40.782144 | NaN | 2 | 3.30 | CRD | 16.5 | 1.0 | 1 | Others | 2009 |
| 173210 | 1071836 | CMT | 2009-04-02 19:34:05+00:00 | 2009-04-02 19:42:52+00:00 | -73.992797 | 40.749391 | -73.983266 | 40.762028 | NaN | 2 | 1.40 | CSH | 7.9 | 0.0 | 0 | Others | 2009 |
| 173211 | 1071845 | CMT | 2009-04-16 15:29:13+00:00 | 2009-04-16 15:34:40+00:00 | -73.970144 | 40.748779 | -73.955521 | 40.764692 | NaN | 1 | 1.50 | CSH | 6.1 | 0.0 | 0 | Others | 2009 |
| 173212 | 1071856 | VTS | 2009-01-06 07:48:00+00:00 | 2009-01-06 07:52:00+00:00 | -73.990193 | 40.775940 | -73.979807 | 40.753225 | NaN | 5 | 2.94 | CSH | 9.3 | 0.0 | 0 | Others | 2009 |
| 173213 | 1071875 | VTS | 2009-04-15 08:36:00+00:00 | 2009-04-15 08:40:00+00:00 | -73.979832 | 40.781035 | -73.979885 | 40.771055 | NaN | 1 | 1.16 | CSH | 4.9 | 0.0 | 0 | Others | 2009 |
| 173214 | 1071881 | VTS | 2009-10-10 12:18:00+00:00 | 2009-10-10 12:31:00+00:00 | -73.967955 | 40.762550 | -73.992003 | 40.743155 | NaN | 1 | 2.36 | CSH | 9.3 | 0.0 | 0 | Others | 2009 |
| 173215 | 1071895 | CMT | 2009-07-13 09:13:18+00:00 | 2009-07-13 09:36:28+00:00 | -73.964563 | 40.760460 | -73.987274 | 40.752908 | NaN | 1 | 1.80 | CSH | 12.5 | 0.0 | 0 | Others | 2009 |